Web Survey Bibliography
Title Visual Analogue Scales in Internet-based Surveys
Author Gnambs, T.
Year 2005
Access date 29.03.2005
Abstract Rating scales rank among the most popular response formats in the area of empirical social research. In paper-and-pencil questionnaires response formats in many different shapes (such as multiple choice, visual rating scales, BARS) can be found. In this respect Internet-based surveys are still relatively underdeveloped. In most cases only those possibilities that are provided by HTML (such as radio buttons or selection lists) are applied without considering alternatives.The advantages of visual analogue scales in Internet-based questionnaires were analyzed in two online surveys. Two aspects were of main interest: the psychometric quality of the answers given as well as the individual preference of the users. Therefore three different response scales in different shapes were developed and compared to conventional digital scales: in shape of a clickable line (similar to analogue scales in traditional paper-and-pencil questionnaires), a slide and a button scale, where the response control could be moved by pressing one of two buttons located at the scale endings. The results strongly suggest equivalence of the responses on all examined response scales. Though analogue scales allow theoretically for more precise responses than digital scales, it is shown that this increased freedom of response has hardly been used in practice. Variance, mean and factor structure were comparable for all response formats. Due to the reliability slight advantages of the scale in form of a clickable line can be assumed.A general preference for analogue response formats, as it is sometimes presumed in literature, could not be confirmed. Rather, two groups could be identified: the majority of the sample is most satisfied with digital response formats and evaluates analogue scales (particularly due to its unusual mode of usage) rather negatively. Analogue scales (mainly in shape of the slide) are only preferred by a minor part due to the possibility of giving more precise answers.
Abstract - optional In der empirischen Sozialforschung zählen Ratingskalen zu den mit Abstand beliebtesten Erhebungsinstrumenten. Im Rahmen von Papier-und-Bleistift Untersuchungen haben sich Antwortskalen in unterschiedlichster Gestalt (Multiple-Choice, Graphische Ratingskalen, BARS etc.) bewährt. Internet-basierte Erhebungen sind in dieser Beziehung noch relativ wenig entwickelt. In der Regel wird auf die von der Auszeichnungssprache HTML vorgegebenen Möglichkeiten wie Radiobuttons oder Auswahllisten zurückgegriffen ohne Alternativen in Betracht zu ziehen.Im Rahmen von zwei Untersuchungen wurden die Möglichkeiten des Einsatzes von graphischen Analogskalen in Internet-basierten Fragebögen analysiert. Im Zentrum der Betrachtungen standen hierbei einerseits die psychometrische Qualität der Antworten und andererseits die individuelle Präferenz der NutzerInnen.Dazu wurden drei analoge Antwortformate in unterschiedlicher Gestaltungsform entwickelt und herkömmlichen Digitalskalen gegenüber gestellt: in Form einer anklickbaren Linie (wie sie Analogskalen in Papier-und-Bleistift Erhebungen ähneln), eines Schiebereglers und einer Buttonskala, auf der durch Drücken zweier an den Skalenpolen angeordneter Buttons der Antwortregler auf einer Linie bewegt werden konnte. Die Ergebnisse vorliegender Untersuchungen belegen weitgehende Äquivalenz der Itemantworten bei allen eingesetzten Antwortskalen. Theoretisch ermöglichen Analogskalen zwar genauere Antworten als digitale Formate, vorliegenden Resultaten zufolge wird diese größere Antwortfreiheit allerdings praktisch nur eingeschränkt genutzt. So ergaben Varianz, Mittelwert und Faktorenstruktur bei allen Antwortformaten vergleichbare Ergebnisse. Aufgrund der Reliabilität lässt sich eine leichte Überlegenheit der Skala in Gestalt einer anklickbaren Linie feststellen.Eine allgemeine Präferenz der NutzerInnen für analoge Antwortformate gegenüber digitalen, wie sie in der Literatur häufig postuliert wird, konnte nicht bestätigt werden. Vielmehr lassen sich diesbezüglich zwei Gruppen identifizieren: der Großteil der Befragten ist mit digitalen Antwortformaten zufrieden und steht Analogskalen (vor allem aufgrund ihrer ungewohnten Bedienung) eher kritisch gegenüber. Nur ein Teil bevorzugt aufgrund deren größerer Antwortfreiheit Analogskalen (vornehmlich in Gestalt des Schiebereglers).
Access/Direct link Homepage - conference (abstract)
Year of publication2005
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - 2005 (76)
- The ethics of research using electronic mail discussion groups; 2005; Kralik, D., Warren, J., Koch, T., Pignone, G., Price, K.
- The Analyses of Domestic Study about Internet Survey; 2005; Rui, L., Tie-ying, S.
- Controlling the Baseline Speed of Respondents: An Empirical Evaluation of Data Treatment Methods of...; 2005; Mayerl, J.
- Determinanten der Rücklaufquote in Online-Panels; 2005; Batanic, B., Moser, K.
- On the cost-efficiency of probability sampling based mail surveys with a Web response option; 2005; Werner, P.
- Expert workshop on mixed mode data collection in comparative social surveys; 2005; Roberts, C.
- The Effect Of A Simultaneous Mixed-Mode (Mail And Web) Survey On Respondent Characteristics And Survey...; 2005; Brennan, M.
- The total survey error approach. A guide to the new science of survey research; 2005; Weisberg, H. F.
- The professional respondent problem in online panel surveys today; 2005; Fulgoni, G.
- Satisficing behavior in online panelists; 2005; Downes-Le Guin, T.
- Reading behavior in the digital environment: Changes in reading behavior over the past ten years; 2005; Liu, Z.
- Rating versus comparative trade-off measures. Trending changes in political issues across time and predictive...; 2005; Thomas, R. K., Behnke, S., Johnson, Al., Sanders, M.
- Publication bias: Recognizing the problem, understanding its origins and scope, and preventing harm; 2005; Dickersin, K.
- Panel proliferation and quality concerns; 2005; Faasse, J.
- Gricean effects in self-administered survey. Ph.D. Dissertation; 2005; Yan, T.
- Drop-down boxes, radio buttons, or fill-in-the-blank? Web survey scale-type effects; 2005
- Does weighting for nonresponse increase the variance of survey means?; 2005; Little, R. J., Vartivarian, S.
- Big scale observations gathered with the help of client side paradata; 2005; Haraldsen, G., Kleven, O., Sundvoll, A.
- User Interface Design and Evaluation ; 2005; Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.
- Adding Value to Data Through Improved Access. The Case for Web Portals; 2005; Baker, R. P.
- Multi-Mode Research and Data Linkage. Theoretical and Practical Advice; 2005; Terhanian, G.
- Architectural Design of a Survey Questionnaire and Respondent Data Repository. Practical Considerations...; 2005; Cookson, P., Sobell, J.
- Developing and validating a nursing website evaluation questionnaire; 2005; Tsai, S. - L., Chai, S.-K.
- Workaround: Site’s surveys beat pop-up blockers, yield responses; 2005; Arnold, C.
- The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research; 2005; Konstan, J. A., Ross, M. W., Rosser, B. R. S., Stanton, J. M., Edwards, W. M.
- Standards in Online Surveys. Sources for Professional Codes of Conduct, Ethical Guidelines and Quality...; 2005; Kaczmirek, L., Schulze, N.
- Computer adaptive testing; 2005; Gershon, R. C.
- Ego control and ego-resiliency: Generalization of self-report scales based on personality descriptions...; 2005; Block, J., Funder, D. C., Letzring, T. D.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.
- Survey of substance use among high school students in Taipei: Web-based questionnaire versus paper-and...; 2005; Wang, Y. C., Lee, C. M., Lew-Ting, C. Y., Hsiao, C. K., Chen, W. J.
- Web Surveys. A Brief Guide on Usability and Implementation Issues; 2005; Kaczmirek, L.
- An assessment of measurement invariance between online and mail surveys ; 2005; Deutskens, E., de Ruyter, K., Wetzels, M.
- E-mail versus Web survey response rates among health education professionals; 2005; Kittleson, M. J., Brown, S. L.
- Toward An Open-Source Methodology: What We Can Learn From The Blogosphere; 2005; M.
- Aux Abonnes Absents: Liste Rouge Et Telephone Portable Dans Les Enquetes En Population Generale Sur...; 2005; Beck, F., ., Peretti-Watel, P.
- Web Versus Paper Questionnares: A Design and Functionality - Comparison; 2005; Jones, Ja., Fraser, C., Dowling, Z.
- Web Surveys and the new Disability Discrimination Act; 2005; Macer, T.
- Mixed-mode Surveys Using Mail and Web Questionnaires; 2005; Meckel, M., Baugh, P., Walters, D.
- Sampling procedure, questionnaire design, online implementation; 2005; Jackob, N., Arens, J., Zerback, T., Jowell, R., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S.
- Alternative Modes for Health Surveillance Surveys: An Experiment with Web, Mail, and Telephone; 2005; Link, M. W., Mokdad, A.
- An Experimental Comparison Of Web And Telephone Surveys; 2005; Fricker, S., Galesic, M., Tourangeau, R., Yan, T.
- Organizational Virtual Communities: Exploring Motivations Behind Online Panel Participation; 2005; Daugherty, T., Lee, W.-N., Gangadharbatla, H., Kim, K., Outhavong, S.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Is a Web survey as effective as a mail survey? A field experiment among computer users; 2005; Kiernan, N. E., Kiernan, M., Oyler, M. A., Gilles, C.
- The effect of personalization on response rates and data quality in web surveys; 2005; Heerwegh, D., Vanhove, T., Matthijs, K., Loosveldt, G.
- When Methodology Interferes With Substance; 2005; Schoen, H., Faas, T.
- Web-based and Mailed Questionnaires: A Comparison of Response Rates and Compliance; 2005; Baelter, K., Balter, O., Fondell, E., Trolle-Lagerros, Y.
- Bleeding Edge or Proven Technology? The Fact and the Fiction of Mobile Survey Computing; 2005; Cameron, M. R.